Estimating Physical Camera Parameters based on Multi-Sprite Motion Estimation
نویسنده
چکیده
Global-motion estimation algorithms as they are employed in the MPEG-4 or H.264 video coding standards describe motion with a set of abstract parameters. These parameters model the camera motion, but they cannot be directly related to a physical meaning like rotation angles or the focal-length. We present a two step algorithm to factorize these abstract parameters into physically meaningful operations. The first step applies a fast linear estimation method. In an optional second step, these parameters can be refined with a non-linear optimization algorithm. The attractivity of our algorithm is its combination with the multi-sprite concept that allows for unrestricted rotational camera motion, including varying of focal-lengths. We present results for several sequences, including the well-known stefan sequence, which can only be processed with the multi-sprite approach.
منابع مشابه
An online approach for multi-sprite generation based on physical camera parameters estimation
We propose in this work to synthesize online the visual content of a complex video into multiple sprites, while detecting on-the-fly each sprite’s limits. For each received frame, physically meaningful camera rotation angles and focal lengths are firstly estimated from frame-to-sprite homography. These physical parameters are then used by a thresholding-based assignment stage to confirm if the ...
متن کاملBackground Sprite Generation Using MPEG Motion Vectors
Sprite coding, accepted by the emerging MPEG-4 standard is a very efficient method for representing the background video object. Still this sprite generation is an open issue due to the foreground objects which obstructs the accuracy of camera motion estimation and blurs the generated sprite. In this paper we propose a method for constructing the background sprite with partial decoding of the M...
متن کاملAutomatic Video Object Segmentation from VOP
The video coding standard MPEG-4 is enabling content-based functionalities of a prior decomposition of sequences into video object planes (VOP) so that each VOP represents a semantic object. Therefore extraction of semantic objects is an important part. There are various coding tools: shape coding, motion estimation and compensation, texture coding, multifunctional coding, error resilience, spr...
متن کاملSynthetic Video Generation for Evaluation of Sprite Generation
Sprite generation is the process of aligning, warping, and blending of pixels that belong to an object in a video. The evaluation of the correctness of a sprite is usually accomplished by a combination of objective and subjective evaluations. Availability of ground-truth image would help mere objective evaluation. In this paper, the authors present video generation from an image based on variou...
متن کاملOptimal Multiple Sprite Generation based on Physical Camera Parameter Estimation
We present a robust and computational low complex method to estimate the physical camera parameters, intrinsic and extrinsic, for scene shots captured by cameras applying pan, tilt, rotation, and zoom. These parameters are then used to split a sequence of frames into several subsequences in an optimal way to generate multiple sprites. Hereby, optimal means a minimal usage of memory while keepin...
متن کامل